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The  purpose  of  this  section  is  to  discuss  various  measures  of  performance,  including 
detection  threshold  (DT),  recognition  differential  (RD),  and  minimum  detectable  signal 
(MDS).  These  measures  have  a  common  ground  in  that  they  represent  the  input  ratio  of 
signal  power  to  noise  power  spectral  density  required  to  achieve  a  given  probability  of 
detection  (PD),  when  signal  is  present,  or  probability  of  false  alarm  (PFA),  when  signal 
is  absent.  The  relationship  between  the  latter  terms  is  often  displayed  graphically  for 
various  parameterizations  of  input  signal-to-noise  power  ratio,  processing  bandwidth  (W), 
and  integration  time  (T)  in  the  form  of  “receiver  operating  characteristic”  (ROC)  curves. 
Such  curves  depend  on  the  processor’s  output  statistics,  whose  distribution  functions 
are  usually  hypothetical. 

In  this  section  an  analytical  model  is  first  derived  for  the  probability  of  detection 
of  a  narrowband  processor.  This  model  is  then  reconciled  with  an  empirically  derived 
model  of  performance. 

DERIVATION  OF  ANALYTICAL  MODEL 

Consider  first  the  statistics  of  a  processor’s  output  as  represented  by  figure  1 .  The 
abscissa  is  the  output  voltage  x.  The  probability  P(x)  that  noise  alone  or  signal  plus  noise 
will  be  observed  to  have  the  value  x  is  given  by  the  incremental  area  under  the  oridinate. 
The  noise  statistics  have  a  mean  and  a  standard  deviation  o^;  the  signal-plus-noise 
statistics  have  a  mean  |iS+N  and  a  standard  deviation  o$+N-  The  term  k  rePresents  the 
detector  threshold;  that  is,  if  a  value  of  x  greater  than  k  is  observed,  a  signal  will  be  declared 
present.  This  threshold  is  set  d  j  above  the  noise  mean  to  achieve  a  desired  probability 
of  false  alarm.  The  probability  of  detection  will  depend  on  the  distance  between  threshold 
k  and  the  signal-plus-noise  mean.  This  distance  is  equal  to  d2  ®s+N‘  The  terms  dj  and  d2 
are  components  of  the  detection  index  d. 

When  the  probability  function  P(x)  is  assumed  to  be  Gaussian,  the  detection  index 
is  defined  as 

("s+n-^n)2 


d2°S+N 


Figure  1 .  General  representation  of  statistics  of  processor  performance. 
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This  is  the  parameter  used  by  Peterson,  Birdsall,  and  Fox,^  whose  ROC  curves  are  presented 
in  figure  2.  In  this  case  the  probability  of  detection  is  defined  by 


PD  =  (2rr  o2+n)  /: 

,  r 

1  exp 

1  (X“^S+N)2 

2  o2 

Jk 

°S+N 

dx. 


The  threshold  is  set  at  a  multiple  of  the  standard  deviation  of  the  noise  above  the  noise 
mean: 


(2) 


k"**N  +  dl  oN. 

By  a  change  of  variable  the  probability  of  detection  becomes 


PD  =  (2  n)-^ 


/•OO 

J(k- 


exp  (-y2/2)  dy. 


-Ms+N')/°S+N 

Expressing  the  lower  limit  of  equation  (4)  in  terms  of  equation  (3)  yields 

k~**S+N  =  **N  +  dl  °N~**S+N 
°S+N  °S+N 


(3) 


(4) 


/**S+N~**N\ 
V  °S+N  ) 


+  di 


gN 

aS+N  ’ 


which  permits  equation  (4)  to  be  rewritten  as 

•c 


[ 


PD  =  (2ir)  ^  I  exp  (-x2/2)  dx, 


where 


(5) 


(6) 


(7) 


All  terms  in  the  above  equations  except  d  j  are  fixed  by  the  nature  of  the  processor  and  its 
input.  The  choice  of  dj  determines  probability  of  detection  and  probability  of  false  alarm. 


^W.W.  Peterson.  T.G.  Birdsall.  and  W.C.  Fox,  “The  Theory  of  Signal  Detectability,”  Trans  IRE,  vol  PG1T4, 
1954. 


For  square-law  processors  the  output  statistics  have  the  following  values: 

H S+N  =  S  +  N,  os+N  =  (S  +  NVCTW)*4  , 

/iN  =  N,  on  =  N/(TW)^. 

Applying  these  values  to  equation  (1)  yields 

d  =  TW(S/N)2  .  (8) 

Solving  for  the  ratio  of  input  signal  power  to  noise  power  spectral  density  yields 

S/Nq  =  (dW)fyT^  ,  N  =  N0W  .  (9) 

This  ratio  expressed  in  decibels  is  called  the  detection  threshold,  which  for  a  square  law 
processor  is  given  by 

DT  =  5  log  d  +  5  log  W  -  5  log  T  .  (10) 


I - 1 - 1 — i - 1 - 1 - 1 — i — l - 1 - 1 - 1 - 1 

0.0001  0.01  0.2  1  5  20  40  60  80  95  99  99.9  99.999 

PROBABILITY  OF  FALSE  ALARM  (%) 

Figure  2.  Receiver  operating  characteristic  (ROC)  curves  for  matched  filter  and  autocorrelator. 
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By  equation  (7)  it  can  be  observed  that  if  one  chooses  dj  to  be  equal  to  the  square-root  of 
the  detection  index  d,  then  C  is  zero,  and  the  probability  detection  is  0.5.  The  detection 
threshold  for  this  probability  is  sometimes  referred  to  as  the  recognition  differential. 

If  the  probability  P(x)  is  assumed  to  have  a  chi-squared  distribution,  the  nomo¬ 
graphs  of  Pryor^  rather  than  the  ROC  curves  of  Peterson  et  al  1  are  applicable.  In  this 
case  performance  is  parameterized  by  a  threshold  detector  ratio  defined  as  the  square 
root  of  equation  (1),  which  expressed  in  terms  of  figure  1  is: 

As  before,  for  the  square-law  processor,  the  output  statistics  have  the  following  values: 

#in  =  N,  mS+N  =  S  +  N-  °N  =  N/(TW)1/2 . 


Equation  (11)  thus  becomes 

dj  =  (S/N)  (TW)1/2  .  (12) 

Solving  for  the  ratio  of  input  signal  power  to  noise  power  spectral  density  yields 

S/N0  =  d1(W/T)‘/2.  (13) 

The  minimum  detectable  signal  defined  by  Pryor  is  this  ratio  expressed  in  decibels: 

MDS  -  1 0  log  d  j  +  5  log  W  -  5  log  T.  (14) 

Implicit  in  Pryor’s^  derivation  of  equation  (14)  is  processor  operation  at  a 
probability  detection  of  0.5.  Pryor  explicitly  states  that,  when  dj  =  1 ,  this  expression 
yields  the  basic  MDS  and  that  PD  =  0.5  and  PFA  =  0.16.  This  is  the  same  resujt  one 
obtains  under  the  Gaussian  hypothesis.  Note  that,  as  previously  observed,  if  d  -  dj  in 
equation  (7),  PD  =  0.5.  If  in  addition  d  j  =  1 ,  then  the  area  under  P(x)  beyond  1  ojyj  is 
0.158.  For  these  particular  conditions,  recognition  differential  (RD),  detection  threshold 
(DT),  and  minimum  detectable  signal  (MDS)  are  the  same.  For  other  conditions  detec¬ 
tion  thresholds  derived  from  tabulations  of  Gaussian  cumulative  density  functions  differ 
slightly  from  minimum  detectable  signal  levels  based  on  chi-squared  statistics.  Results 
obtained  with  the  more  readily  accessible  Gaussian  tables  are  usually  conceded  to  converge 
to  those  from  the  possibly  more  accurate  chi-squared  tables  when  the  latter  have  at  least 
20  to  30  degrees  of  freedom. 

Table  1  shows  values  of  detection  threshold  and  minimum  detectable  signal  for 
several  probabilities  of  detection  and  false  alarm  for  a  square-law  processor  with  36  degrees 
of  freedom,  ie,  TW  =18.  It  can  readily  be  seen  that  at  performance  levels  of  interest  the 
difference  in  the  required  input  ratio  of  signal  power  to  noise  power  spectral  density  pre¬ 
dicted  by  the  two  statistical  models  is  negligible.  For  convenience  the  Gaussian  model  will, 
thus,  be  used  in  the  remainder  of  this  analysis. 


^Naval  Ordnance  Laboratory,  NOL-TR-71  -92,  Calculation  of  the  Minimum  Detectable  Signal  for  Practical 
Spectrum  Analyzers,  by  C.N.  Pryor,  2  August  1971 . 
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Table  1.  Detection  threshold  (DT)  and  minimum  detectable  signal  (MDS)  as  a 
function  of  probability  of  detection  (PD)  and  probability  of  false  alarm  (PFA). 


PD 

PFA 

DT  (dB) 

MDS  (dB) 

0.5 

0.16 

-23.3 

-23.3 

0.5 

10"4 

-17.6 

-16.6 

0.5 

10-6 

-16.5 

-15.1 

0.9 

10"6 

-13.9 

-13.5 

RECONCILIATION  WITH  EMPIRICAL  MODEL 

The  foregoing  analytic  measures  of  performance  must  now  be  reconciled  with 
empirical  measures.  Equation  (15)  shown  below  is  a  widely  used  empirically  derived 
model 


PD  =  (2ir)"I/2 


f 


SE/ose 


exp  (-y2/2)  dy. 


(15) 


where  signal  excess  SE  (in  dB)  is  normally  distributed  with  zero  mean  and  standard  devia¬ 
tion  o§£  of  7.8  dB.  The  performance  indicated  by  equation  (15)  is  at  an  unspecified  but 
low  probability  of  false  alarm. 

The  analytic  expression  of  equation  (6)  takes  into  account  only  the  statistical 
behavior  signals  of  constant  power  masked  by  noise  of  constant  power,  whereas  the 
empirical  model  of  equation  (15)  includes  the  composite  effect  of  waveform  statistics 
and  power  fluctuations,  as  well  as  the  effect  of  the  human  operator  on  the  detection 
process.  At  the  same  time,  however,  the  analytical  and  empirical  expressions  are  of  the 
same  form.  Thus,  if  one  equates  the  upper  limit  of  the  integrals,  one  obtains 

C  =  SE/og£,  (16) 


(17) 


where  C  is  as  defined  in  equation  (7).  If  one  now  notes  from  figure  1  that 
^S+N  ~ Mn  =  di  °N  +  d2  aS+N ’ 
and  if  one  then  substitutes  equations  ( 1 6)  and  (17)  into  equation  (7),  one  obtains 

d2  =  SE/ojjj;.  (18'» 


Furthermore,  one  may  note  that  the  ratio  of  signal  power-to-noise  power  spectral 
density  at  the  processor  input  is  given  by 


S/Nq  =  SE  +  DT  =  SL  -  PL  +  AG  -  N0. 


(19) 


Where  SL  is  the  source  level  of  the  signal,  PL  is  propagation  loss,  and  AG  is  array  gain  in 
accord  with  usual  sonar  equation  definitions. 


■■  . 


Using  equation  (18)  one  may  rewrite  this  expression  as 


S/N0  =  (d2  oSE  +  DT) .  (20) 

Power  fluctuations  are  thus  shown  to  require  a  straightforward  increase  in  input  signal-to- 
noise  power  ratio  with  respect  to  the  detection  threshold  predicted  solely  by  the  analytical 
model.  The  amount  of  increase  depends  on  the  empirical  constant  o§E  (7.8  dB)  and  the 
factor  d2  used  to  establish  the  processor’s  probability  of  detection  in  the  absence  of 
fluctuations. 

DERIVATION  OF  PERFORMANCE  EQUATIONS  FOR  A  BROADBAND 
COHERENT  RECEIVER 

The  general  problem  is  one  of  binary  hypothesis  testing,  where 
r1(t)  =  n1(t) 

H0 

r2(t)  =  n2(t) 

rt  (t)  =  si(t)  +  n>(t) 

H1 

r2(t)  =  s2(t)  +  n2(t) 

We  choose  to  use  as  test  statistic  the  finite-time  cross-correlation  between  the  two 
received  signals  given  by 

r 

x=  rj(t)  r2(t)  dt  (21) 

Jo 

We  recognize  that,  in  general,  this  is  not  an  optimal  test  statistic  for  deciding  which 
hypothesis  is  true.  The  statistics  forx  will  not,  in  general,  be  Gaussian  even  though  all 
signals  and  noises  can  be  Gaussian.  Thus,  the  applicability  of  the  performance  index  d. 
particularly  as  an  output  signal-to-noise  ratio,  must  be  viewed  cautiously.  The  general 
formulations  and  signal  representations  are  taken  from  Urkowitz3,  who  addressed  the 
question  of  energy  detection  of  one  signal.  The  following  extensions  were  derived  in  col¬ 
laboration  with  Dr.  E.L.  Titlebaum,  of  the  University  of  Rochester. 

Assume  that  the  received  signals  are  deterministic  and  have  been  spectrally  limited 
by  a  low-pass  filter  whose  bandwidth  is  W  Hz.  The  noise  signals  are  assumed  to  be  statis¬ 
tically  independent  white  Gaussian  processes.  This  may  require  inclusion  of  a  prewhitening 
filter  in  each  channel.  The  noise  signals  are  assumed  to  have  zero  means  with  two-sided 
power  density  spectra 

Snj(w)  =  Nj  watts/Hz 


3H.  Ufkowitz,  Energy  Detection  of  Unknown  Deterministic  Signals,  Proc.  IEEE,  vol  55,  pp  523-53 1 , 
April  1967. 


S02  (w)  =  N2  watts/Hz 


over  the  band  of  W  Hz. 


Following  Urkowitz^,  we  represent  each  noise  voltage  with  2TW  samples  and  form 
2TW 

ni<t)  =  aj(k)  sine  (2Wt  -  k),  i  =  1 , 2  (22) 


where 


ai(k)  =  ni(k/2W)  . 


For  each  i,  the  set  of  noise  samples  {aj(k)}  is  assumed  to  be  zero-mean,  uncorrelated 
Gaussian  random  variables  with  identical  variance 

var  [a:(k)]  =  a2  =  2N:W. 

*  n  j  1 


(23) 


We  also  have  that 

*T 


n 

j  n?(t)  dt  *  af  (k* ' 

JO  k=l 


(24) 


The  signal  processes  which  are  assumed  to  be  constant  with  respect  to  any  ensemble  average, 

eg, 

E[Si(t)]  =Si(t). 

are  similarly  sampled  every  1/2W  second  yielding  the  expansion 
2TW 

si(t)  =  si<k>  sinc  <2Wt  "  k>>  1  =  1  -  2,  (25) 

k=l 

where 

Sj(k)  =  Sj(k/2W) , 
and  has  moments 


ElSj(k)  Sj(8)l  =  o25ke, 
ElSj(k)  S2(8>1  =paj  a2  5kg 


(26) 


(27) 


We  also  have  that 


r  T  2TW 

Jo  k=l 


2(k)  -  Ei 


£1 

sj(t)  s2(t)  dt  =  Sj(k)  S2(k)  =  p 


Here  p  is  interpreted  as  the  projection  of  one  (energy  normalized)  signal  on  the  other.  We 
will  express  the  final  answer  for  d  in  terms  of  the  average  power  for  each  signal  using  the 
relation 

Pi  =  Ej/T  .  (1 

Now  we  define  d  as 

„  |E[XIH|l-E[xlH0l[2 
var  [XIHj  ] 

Finally  the  test  statistic,*,  may  be  expressed  as 


^  I  n 

X  =  2W  ^2  rl  (k/2W)  r2  (k/2W)  ’ 


where  under 


rj(k/2W)  =  aj(k),  i-1,2 


and  under  H  i 


ri(k/2W)  =  Sj(k)  +  ajfk),  i-1,2 
and  we  proceed  to  calculate  the  quantities  in  this  expression. 


1.  Elx\H0l 


Since  both  signals  and  noises  may  be  correlated  but  still  independent  of  each  other 
the  first  quantity  becomes 

2TW 

EIxIHq]  =  2^r  2  Elaj(k)  a2(fi)]  (3 

k=l 


E [a j (k)  a2(fi)l  =  PN  an]  on2  6kg  . 

Using  equation  (36)  in  (35)  we  have  that 
E(XIH01  =  T  Pjsj  ffnj  °n2  • 

2.  ElX\Hj] 

For  the  second  term  we  have 
2TW 

ElxIHj]—  E  •|(S1(k)  +  aj(k)]  [S2(k)  + 
k=l 
2TW 

=  2W  ^  j  ^  1  (k)  S200  +  T  Pjq  onj  un2  > 
k=l 

and  using  equation  (29)  we  obtain 

EIx'Hj]  =P  JE^  +  Tpj*  oni  on2  , 

3.  ElX2\H1l 

For  the  term  ElX2  I H  j  ]  we  have 

2TW 

E[x2IHj]  =— ~2  ^2  E|(S](k)  +  a,(k)l  is2(k)  +  a2(k)l 

4W  M^l 

•  [S,(£)  +  a,(8)l  [S2(8)  +  a2(B)]|  . 


(3 

(3 


(3 


(3 


(4i 


There  are  16  terms  in  the  summand  which  ''an  be  characterized  as  follows: 


1.  S1(k)S2(k)S,(fi)S2(8) 

2.  SjWS^klSjODa^fi) 

3.  Sj(k)  S2(k)  aj(C)  S2(C) 

4.  S,(k)  S2(k)  a,(fi)  a2(8) 

5.  S,(k)a2(k)S  ,(8)82(8) 

6.  Sj(k)  a2(k)  Sj(C)  a2(fi) 

7.  S,(k)a2(k)a,(8)S2(8) 

8.  S,(k)  a2(k)  a,(8)  a2(8) 


9.  aj(k)  S2(k)  S,(8)  S2(8) 

10.  a, (k)S2(k)S ,(8)32(8) 

11.  a,(k)S2(k)a,(8)S2(£) 

12.  aj(k)S2(k)a,(8)a2(e) 

13.  a,(k)a2(k)S,(£)S2(8) 

14.  a,(k)  a2(k)  S,(£)  a2(8) 

15.  a,(k)a2(k)aj(8)S2(8) 

16.  a,(k)  a2(k)  a,(8)  a2(8) 


Taking  expectations  of  each  we  have  16  terms,  eight  of  which  are  nonzero.  We  will  simply 
catalogue  the  nonzero  results  here: 

Term  1  =  p2  E,E2  . 

Term  4  =  T  pN  anj  on2  •  p  J E,E2  . 

Term  6  =  ^r  E,  a2  . 

2W  1  n2 

Term7=^-pN  oni  an2  •  p  JE,E2  . 

Term  1 0  =  term  7  . 

Term  11  =  ^  E2  . 

Term  13  =  term  4  . 

Term  16  =  E[x2iHg]. 

Summing  all  these  results  yields  that 

E[x2|H,  ]  =  p2  E,E2  +  2  ^T  pN  anj  on2  p  jE,E2] 

+  2W  [°n,  E2  +  0n2El]  +W  [pNan,  an2  P  JE\E2  ] 

+  ^1 [l  +  (1  +  2TW)  p2  ]  . 
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.  •  -.I- 


•  •  v*  V 


(4 


4.  VarlWHjl 

We  calculate  this  by  subtracting  from  equation  (41 )  the  square  of  (39)  which  after 
eliminating  common  terms  yields  that 


var 


+  T  a 

Now  we  may  calculate  d  to  be 


lxlHl 1  =  ^  |an!  E2  +  an2  El  +  2  P  PN  ^  °n2 

2  *2 

nl  n2  l  *N_|  j 


d  = 


2W  p2  E  jE2 


an,  E2  +  an2  E1  +  2  P  PN  °nl  °n2  +  T  0nj  an2  (J  +  4) 


Now  using  equation  (30),  so  that  we  have  everything  expressed  in  terms  of  average 
powers,  results  in 


d  =  2TW 


(42) 


(43) 


(44) 


We  now  apply  equation  (45)  in  several  special  cases. 

Case  1 

For  the  case  of  equal  signal-to-noise  ratios  =  ^o2^/P2j  =  ^o^/p)  ,  we 


obtain 


d  =  2TW 


$*•»»($>(?)  M 


Case  la 


For  the  case  of  uncorrelated  noise,  =  0,  then  we  have 

k2 


te): 


d  =  2TWp2— 
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For  the  case  of  energy  detection  of  one  channel  with  low  signal-to-noise  ratio, 

where  p  =  pxj  =  1,  Pi  =P7  =P,a^  =  =  o^,  and  (o^/P  >  1),  then  we  obtain 

^  1  ^  nj  112  n  n 


dsTW 


2 


This  is  the  usual  result  for  a  simple  square  law  detector. 


Case  3 


we  obtain 


For  the  case  of  one  high  signal-to-noise  ratio  and  one  low,  / P  j  >  1 ,  o^/P->  <  1 


which  corresponds  to  the  result  for  a  matched  filter  detector. 

The  results  are  comparable  to  those  found  in  Urick4,  except  that  he  did  not  consider 
any  cases  for  which  the  signal  components  in  each  channel  were,  in  any  way,  different.  Thus, 
to  compare  results,  p2  must  be  set  to  unity. 


^.L.  Urick,  Principles  of  Underwater  Sound  for  Engineers,  New  York,  McGraw-Hill,  chap  12,  1967. 


